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DETAILED ACTION 

1 . It is hereby acknowledged that 10/784957 the following papers have been received 
and placed of record in the file: Amendment date 05/24/10. 

2. Claims 1,4-8, 13-17, 20-24, 29-32, and 39-40 are presented for examination. 
Claims 1 & 17 are independent claims. Claims 1 & 17 are being amended. 

Response to Arguments 

3. Applicant's arguments with respect to claims 1 , 4-8, 1 3-1 7, 20-24, 29-32, and 39- 
40 have been considered but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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5. Claims 1, 4-8, 13-17, 20-24, 29-32, and 39-40 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over Choi (2003/02369005) in view of Sato (5884004) and in 
further view of Omoigui (7237254), 

Regarding claim 1 , Choi teaches a method of reproducing, by a content reproducing 
device, content information stored on a recording medium the method comprising: 
reproducing a first stream of data read out from the recording medium in 
synchronization with a second stream of data received from a Content providing server 
over a networkfChoi discloses if the streaming is interrupted, the server software 
and the client software exchange messages to re-map a state of the client and re- 
synchronize playback of the content; Paragraph [005])based on a first command 
sent from the content reproducing device to the content providing server, (Choi 
discloses the method further includes receiving, by the client, the streamed 
media content from the server. The method includes sending a reconnect request 
from the client to the server if the streaming is interrupted; see paragraph 8 lines 
7-13) sensing a failure in receiving the second stream of data; (Choi discloses the 
server component and the client component include computer-executable 
instructions for exchanging one or more messages to re-map the state of the 
client and to re-synchronize playback of the content if the streaming is 
interrupted; Paragraph [11]) upon sensing the failure, re-synchronizing the first 
stream of data stream of with the second data based on information for synchronization 
or re- synchronization included in the second stream of data, (Choi discloses If the 
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streaming is interrupted, the server software and the client software exchange 
messages to re-map a state of the client and re-synchronize playback of the 
content; Paragraph [005]) 

Choi does not explicitly disclose the first stream of data comprising audio/video 
data and the second data comprising content data associated with the first stream of 
data; 

However Sato does teaches the first stream of data comprising audio/video data 
and the second data comprising content data associated with the first stream of data; 
(Sato discloses the encoding system controller 200 also generates the 
reproduction time information IT defining the reproduction time of the title editing 
unit (video object, VOB), and the stream encoding data St33 defining the system 
encode parameters for multiplexing the encoded multimedia stream containing 
video, audio, and sub-picture data. Note that the reproduction time information IT 
and stream encoding data St33 are generated for the video object VOB of each 
title in one video zone VZ; Column 9 lines 7-15) 

It would be obvious to a person of ordinary skill in the art at the time of the 
invention to modify the teachings of Choi's system for automatically recovering form 
failed network connections in streaming media scenarios with Sato's optical disc for 
generating a bistream containing a plurality of video objects including video and audio 
data. One of ordinary skill in the art would have been motivated to make this 
modification in order to have a more efficient and seamless reproduction 
method/system. See Saito Column 2 lines 65 -Column 3 line 7. 
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Choi nor Sato discloses explicitly thereby simultaneously and synchronously 
reproducing the first stream of data together with the second stream of data, the 
information including data rate information of the second stream of data and/or size 
information of the second stream of data. 

However Omoigui does teach thereby simultaneously and synchronously 
reproducing the first stream of data together with the second stream of data, the 
information including data rate information of the second stream of data and/or size 
information of the second stream of data. (Omoigui discloses the individual media 
streams have their own timelines, which are synchronized with each other so 
that the media streams can be rendered simultaneously for a coordinated 
multimedia presentation. The individual timelines define the timeline of the 
composite stream; see Column 6 lines 4-9, for data rate also see Column 12 lines 
37-42) 

It would be obvious to a person of ordinary skill in the art at the time of the 
invention to modify the teachings of Choi and Saito to include Omoigui's seamless 
switching between different playback speeds of time-scale modified data streams. One 
of ordinary skill in the art at the time of the invention would have been motivated to 
make this modification in order to have a streaming system which allows for a more 
efficient way to alter speeds of streams. See Omoigui column 1 lines 62- column 2 
lines 10. 



Application/Control Number: 10/784,957 Page 6 

Art Unit: 2446 

Regarding claim 4, the modified Choi taught the method according to claim 1 , as 
described above. Choi further teaches wherein the information is contained within a 
header of the second stream of data. (Choi discloses when the distribution 
connection recovers, the server software 11 sends another stream header before 
streaming the content; Page 7 paragraph 93 lines 6-8) 

Regarding claim 5, the modified Choi taught the method according to claim 1 , as 
described above. Choi further teaches wherein the sensing 
step includes sensing whether the failure in receiving the second data is due to a 
disconnection or a delay of transmission of the second stream of data over the network. 
(Choi discloses the method further includes receiving, by the client, the streamed 
media content from the server. The method includes sending a reconnect request 
from the client to the server if the streaming is interrupted; Page 2 paragraph 8 
lines 7-13) 

Regarding claim 6, the modified Choi taught the method according to claim 1 , as 
described above. Omoigui also teaches further comprising: 

delaying a time for re-synchronization, wherein during the re-synchronization delay the 
first stream of data is reproduced, and the second stream of data is muted and not 
reproduced. (Omoigui discloses thus, client 104 is able to render the streams at 
the new playback speed with very little (if any) noticeable delay and little or no 
noticeable break or pause between the user's submission of the new playback 
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speed and the actual rendering at the new playback speed; Column 12 lines 51- 
55) 



Regarding claim 7, the modified Choi taught the method according to claim 1 , as 
described above. Omoigui also teaches further comprising: 

delaying a time, for re-synchronization, wherein during the re-synchronization delay the 
first stream of data is reproduced, and an interpolated second stream of data is 
reproduced. (Omoigui discloses the invention switches between these different 
playback speeds in a seamless manner, advantageously reducing breaks and/or 
delays between the time the user selects the new playback speed and the time 
the multimedia content begins being played back at the new speed; Column 15 
lines 35-40) 



Regarding claim 8, the modified Choi taught the method according to claim 1 , as 
described above. Omoigui also teaches further comprising: delaying a time for re- 
synchronization, wherein during the re-synchronization delay the first stream of data is 
reproduced, and a previous segment of the second stream of data is reproduced. 
(Omoigui discloses the invention switches between these different playback 
speeds in a seamless manner, advantageously reducing breaks and/or delays 
between the time the user selects the new playback speed and the time the 
multimedia content begins being played back at the new speed; Column 15 lines 
35-40) 
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Regarding claim 13, the modified Choi taught the method according to claim 1 , as 
described above. Sato further teaches wherein said re-synchronization step includes: 
calculating an offset value for the second stream of data to establish re-synchronization; 
sending a second command requesting transmission of the second stream of data 
corresponding to the calculated offset value from the content producing device to the 
content providing server ; (Sato discloses the audio start gap A.sub.- STGAP is the 
time offset between the start of the audio and video presentation at the beginning 
of a VOB. This is a useful parameter for declaring seamless reproduction with the 
preceding encoded system stream; Column 61 line 27-30)an6 
re-synchronizing the second stream of data transmitted in response to the second 
command with the first stream of data read out from the recording medium. (Omoigui 
discloses in embodiments where server 102 includes an intelligent data transfer 
mechanism to detect the rate at which client 104 is accepting data, client 104 and 
server 102 eventually resynchronize (step 310).; Column 12 lines 51-55) 

Regarding claim 14, the modified Choi taught the method according to claim 13, as 
described above. Sato further teaches wherein said calculating step is based on a 
present playing time of the first stream of data and a number of bytes per second of the 
second stream of data. (Safo discloses though comprising two recording surfaces 
similarly to the recording media shown in FIG. 7, the DVD recording medium RC3 
shown in FIG. 8 has the recording surfaces on opposite sides of the disk, i.e., has 
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the first data recording surface RS1 on side SA and the second data recording 
surface RS2 on side SB; Column 14 line 60-65) 

Regarding claim 15, the modified Choi taught the method according to claim 14, as 
described above. Sato further teaches wherein the offset value of the 
second data capable of re-synchronization is calculated by adding the present playing 
time of the first stream of data to a predetermined amount of time to produce a result 
and multiplying the result by the number of bytes per second of the second stream of 
data. (Sato also discloses when the reproducing apparatus of the digital video 
disk system is configured with a disk read rate of 11 Mbps, a maximum AV data 
compression rate of 10 Mbps, and a track buffer (stream buffer 2400) capacity of 4 
Mbits, for example, a data underflow state will occur; Column 37 line 6-10) 

Regarding claim 16, the modified Choi taught the method according to claim 15, as 
described above. Sato further teaches wherein the predetermined 
amount of time is proportional to a speed of the second stream of data being transferred 
over the network. (Sato discloses in order to achieve the aforementioned 
objective, an interleaving method which for the presentation of a bitstream that is 
reproduced by selecting two or more data units from a bitstream comprising 
three or more data units contiguous on the same time-base is characterized by 
generating said bitstream by arranging the selected data units in a particular 
sequence on the same time-base based on the presentation time of each data unit 
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so that it is possible to sequentially access all data units and present only the 
selected data units without time-base intermittence; Column 3 line 18-27) 

Regarding claim 17, Chen teaches an apparatus for reproducing content information 
comprising: a renderer configured to reproduce a first stream of data read out from a 
recording medium in synchronization with a second stream of data received from a 
content providing serverfChoi discloses if the streaming is interrupted, the server 
software and the client software exchange messages to re-map a state of the 
client and re-synchronize playback of the content; Paragraph [005]) over a 
network based on a first command, (Choi discloses the method further includes 
receiving, by the client, the streamed media content from the server. The method 
includes sending a reconnect request from the client to the server if the 
streaming is interrupted; Page 2 paragraph 8 lines 7-13) and 
a processor configured to sense a failure in receiving tile second stream of data (Choi 
discloses the server component and the client component include computer- 
executable instructions for exchanging one or more messages to re-map the 
state of the client and to re-synchronize playback of the content if the streaming 
is interrupted; Paragraph [11]) and upon sensing the failure in, re-synchronize the first 
stream of data with the second stream of data based on information for synchronization 
or re-synchronization including in the second stream of data, (Choi discloses If the 
streaming is interrupted, the server software and the client software exchange 
messages to re-map a state of the client and re-synchronize playback of the 
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content; Paragraph [005]) 

Choi does not explicitly disclose the first stream of data comprising audio/video 
data and the second data comprising content data associated with the first stream of 
data; 

However Sato does teaches the first stream of data comprising audio/video data 
and the second data comprising content data associated with the first stream of data; 
(Sato discloses the encoding system controller 200 also generates the 
reproduction time information IT defining the reproduction time of the title editing 
unit (video object, VOB), and the stream encoding data St33 defining the system 
encode parameters for multiplexing the encoded multimedia stream containing 
video, audio, and sub-picture data. Note that the reproduction time information IT 
and stream encoding data St33 are generated for the video object VOB of each 
title in one video zone VZ; Column 9 lines 7-15) 

It would be obvious to a person of ordinary skill in the art at the time of the 
invention to modify the teachings of Choi's system for automatically recovering form 
failed network connections in streaming media scenarios with Sato's optical disc for 
generating a bistream containing a plurality of video objects including video and audio 
data. One of ordinary skill in the art would have been motivated to make this 
modification in order to have a more efficient and seamless reproduction 
method/system. See Saito Column 2 lines 65 -Column 3 line 7. 

Choi nor Sato discloses explicitly thereby simultaneously and synchronously 
reproducing the first stream of data together with the second stream of data, the 
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information including data rate information of the second stream of data and/or size 
information of the second stream of data. 

However Omoigui does teach thereby simultaneously and synchronously 
reproducing the first stream of data together with the second stream of data, the 
information including data rate information of the second stream of data and/or size 
information of the second stream of data. (Omoigui discloses the individual media 
streams have their own timelines, which are synchronized with each other so 
that the media streams can be rendered simultaneously for a coordinated 
multimedia presentation. The individual timelines define the timeline of the 
composite stream; see Column 6 lines 4-9, for data rate also see Column 12 lines 
37-42) 

It would be obvious to a person of ordinary skill in the art at the time of the 
invention to modify the teachings of Choi and Saito to include Omoigui's seamless 
switching between different playback speeds of time-scale modified data streams. One 
of ordinary skill in the art at the time of the invention would have been motivated to 
make this modification in order to have a streaming system which allows for a more 
efficient way to alter speeds of streams. See Omoigui column 1 lines 62- column 2 
lines 10. 

Regarding claim 20, the modified Choi taught the apparatus according to claim 17, as 
described above. Choi further teaches wherein the information is contained within a 
header of the second stream of data. (Choi discloses when the distribution 
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connection recovers, the server software 11 sends another stream header before 
streaming the content; Page 7 paragraph 93 lines 6-8) 

Regarding claim 21, the modified Choi taught, the apparatus according to claim 17, as 
described above. Choi also teaches wherein the 

processor is configured to determine whether the failure is due to a disconnection or a 
delay of transmission of the second stream of data over the network. (Choi discloses 
the method further includes receiving, by the client, the streamed media content 
from the server. The method includes sending a reconnect request from the client 
to the server if the streaming is interrupted; Page 2 paragraph 8 lines 7-13) 

Regarding claim 22, the modified Choi taught the apparatus according to claim 17, as 
described above. Omoigui further teaches wherein the processor is configured to delay 
a time for re-synchronization, and control such that during the-re- synchronization delay 
the first stream of data is reproduced, and the second stream of data is muted and not 
reproduced, during the re-synchronization delay. (Omoigui discloses thus, client 104 
is able to render the streams at the new playback speed with very little (if any) 
noticeable delay and little or no noticeable break or pause between the user's 
submission of the new playback speed and the actual rendering at the new 
playback speed; Column 12 lines 51-55) 

Regarding claim 23, the modified Choi taught the apparatus according to claim 17, as 
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described above. Omoigui further teaches wherein the 

processor is configured to delay a time for resynchronization, and control such that 
during the resynchronization delay the first stream of data is reproduced, and an 
interpolated second stream of data is reproduced, during the re-synchronization delay. 
(Omoigui discloses the invention switches between these different playback 
speeds in a seamless manner, advantageously reducing breaks and/or delays 
between the time the user selects the new playback speed and the time the 
multimedia content begins being played back at the new speed; Column 15 lines 
35-40) 



Regarding claim 24, the modified Choi taught the apparatus according to claim 17, as 
described above. Omoigui further teaches wherein the processor is configured to delay 
a time for resynchronization, and control such that during resynchronization delay-the 
first data is reproduced, and a previous segment of the second stream of data is 
reproduced, during the re-synchronization delay. (Omoigui discloses in embodiments 
where server 102 includes an intelligent data transfer mechanism to detect the 
rate at which client 104 is accepting data, client 104 and server 102 eventually 
resynchronize (step 310).; Column 12 lines 51-55) 



Regarding claim 29, Chen, Sato, Choi in view of Lear taught the apparatus according to 

claim 17, as described above. Sato further teaches wherein said. 

processor, is configured to re-synchronize the first stream of data and second stream of 
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data, calculating an offset value for the second stream of data to establish re- 
synchronization sending a second data corresponding to the calculated offset value to 
the Content providing server; (Sato discloses the audio start gap A.sub.-- STGAP is 
the time offset between the start of the audio and video presentation at the 
beginning of a VOB. This is a useful parameter for declaring seamless 
reproduction with the preceding encoded system stream; Column 61 line 27-30) 
and re-synchronizing the second stream of data transmitted in response to the second 
command with the first stream of data read out from the recording medium. . (Lear 
discloses thus, multiple simultaneous events may be streamed concurrently on 
separate channels, or channels may be used to transmit delayed copies of the 
same content allowing channel selection as a form of dynamic fast forward and 
rewind; Paragraph 76) 

Regarding claim 30, Chen, Sato, Choi in view of Lear taught the apparatus according to 
claim 29, as described above. Sato further teaches wherein said 
processor is configured to use a present playing time of the first stream of data and a 
number of bytes per second stream of the second data, when calculating the offset 
value, (Sato discloses the audio start gap A.sub.-- STGAP is the time offset 
between the start of the audio and video presentation at the beginning of a VOB. 
This is a useful parameter for declaring seamless reproduction with the 
preceding encoded system stream; Column 61 line 27-30) 
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Regarding claim 31 , the modified Choi taught the apparatus according to claim 30, as 
described above. Sato furher teaches wherein the offset value is calculated by said pr 
the modified Choi of the first stream of data to a predetermined amount of time to 
produce a result and multiplying the result by the number of bytes per second of the 
second stream of data. (Sato also discloses when the reproducing apparatus of the 
digital video disk system is configured with a disk read rate of 11 Mbps, a 
maximum AV data compression rate of 10 Mbps, and a track buffer (stream buffer 
2400) capacity of 4 Mbits, for example, a data underflow state will occur; Column 
37 line 6-10) 

Regarding claim 32, the modified Choi taught the apparatus according to claim 31 , as 
described above. Sato further teaches wherein the predetermined 
amount of time is proportional to a speed of the second stream of data being transferred 
over the network. (Sato discloses in order to achieve the aforementioned 
objective, an interleaving method which for the presentation of a bitstream that is 
reproduced by selecting two or more data units from a bitstream comprising 
three or more data units contiguous on the same time-base is characterized by 
generating said bitstream by arranging the selected data units in a particular 
sequence on the same time-base based on the presentation time of each data unit 
so that it is possible to sequentially access all data units and present only the 
selected data units without time-base intermittence; Column 3 line 18-27) 
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Regarding claim 39, the modified Choi taught the method according to claim 1 , as 
described above. Choi further teaches wherein the step of reproducing comprises: 
buffering the second stream of data prior to synchronization. (Choi discloses if the 
reconnection process occurred relatively quickly, the server 108 may have 
buffered a small amount of the live content, and will deliver that buffered content 
to the client 110 if reconnection is successful; Page 3 paragraph 28 lines 10-14) 
(Gould discloses packets received from the secondary stream are buffered in 
buffer 20 (as more fully explained below). The failover device 16 can distinguish 
the source of the packets because the IP header information in each packet 
contains unique RMIPP; Paragraph 28 lines 2-5) 

Regarding claim 40, the modified Choi taught the apparatus according to claim 17, as 
describe above. Sato further teaches comprising: a buffer configured to buffer the 
second stream of data prior to synchronization. (Sato also discloses when the 
reproducing apparatus of the digital video disk system is configured with a disk 
read rate of 11 Mbps, a maximum AV data compression rate of 10 Mbps, and a 
track buffer (stream buffer 2400) capacity of 4 Mbits, for example, a data 
underflow state will occur; Column 37 line 6-10) 
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Conclusion 

6. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Gerald Smarth whose telephone number is (571)270- 
1923. The examiner can normally be reached on Monday-Friday(7:30am-5:00pm)est. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jeff Pwu can be reached on (571 )272-6798. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/GERALD SMARTH/ 
Examiner, Art Unit 2446 

/Benjamin R Bruckart/ 

Primary Examiner, Art Unit 2446 



